Artificial Intelligence for Artificial Artificial Intelligence
نویسندگان
چکیده
Crowdsourcing platforms such as Amazon Mechanical Turk have become popular for a wide variety of human intelligence tasks; however, quality control continues to be a significant challenge. Recently, we propose TURKONTROL, a theoretical model based on POMDPs to optimize iterative, crowdsourced workflows. However, they neither describe how to learn the model parameters, nor show its effectiveness in a real crowd-sourced setting. Learning is challenging due to the scale of the model and noisy data: there are hundreds of thousands of workers with high-variance abilities. This paper presents an end-to-end system that first learns TURKONTROL’s POMDP parameters from real Mechanical Turk data, and then applies the model to dynamically optimize live tasks. We validate the model and use it to control a successive-improvement process on Mechanical Turk. By modeling worker accuracy and voting patterns, our system produces significantly superior artifacts compared to those generated through nonadaptive workflows using the same
منابع مشابه
An Overview of the Artificial Intelligence Applications in Identifying and Combating the Covid-19 Pandemic
Intruduction: In late 2019, people around the world became infected with Covid-19 by the outbreak, the pandemy and epidemy of this disease. To this end, researchers in various fields are seeking to find solutions to the problems related to the control and management of crises. The transmission power of the new corona virus has drawn the attention of experts in the use of artificial intelligence...
متن کاملArtificial Intelligence in Healthcare
The article is a letter to the editor, so it has no abstract.
متن کاملArtificial Intelligence in Healthcare
The article is a letter to the editor, so it has no abstract.
متن کاملPVT Properties of Pure Lubricants Using Equations of State and Artificial Intelligence
Statistical mechanical and artificial intelligence models are developed to predict the volumetric properties of lubricants under different conditions. It is shown that the knowledge of just liquid density at room temperature is satisfactory to approximate the PVT properties of pure lubricants in various conditions. As well, the performance of an artificial neural network (ANN) based on back pro...
متن کاملArtificial intelligence & genetics
Artificial intelligence (AI) is the development of computer systems that are able to perform tasks that normally require human intelligence. Artificial intelligence (AI) is a wide-ranging tool that enables people to rethink how we integrate information, analyze data, and use the resulting insights to improve decision making—and already it is transforming every walk of life. AI has application...
متن کامل